Good or best practice statements: proposal for the operationalisation and implementation of GRADE guidance.

An evidence-based approach is considered the gold standard for health decision-making. Sometimes, a guideline panel might judge the certainty that the desirable effects of an intervention clearly outweigh its undesirable effects as high, but the body of supportive evidence is indirect. In such cases, the application of the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) approach for grading the strength of recommendations is inappropriate. Instead, the GRADE Working Group has recommended developing ungraded best or good practice statement (GPS) and developed guidance under which circumsances they would be appropriate.Through an evaluation of COVID-1- related recommendations on the eCOVID Recommendation Map (COVID-19.recmap.org), we found that recommendations qualifying a GPS were widespread. However, guideline developers failed to label them as GPS or transparently report justifications for their development. We identified ways to improve and facilitate the operationalisation and implementation of the GRADE guidance for GPS.Herein, we propose a structured process for the development of GPSs that includes applying a sequential order for the GRADE guidance for developing GPS. This operationalisation considers relevant evidence-to-decision criteria when assessing the net consequences of implementing the statement, and reporting information supporting judgments for each criterion. We also propose a standardised table to facilitate the identification of GPS and reporting of their development. This operationalised guidance, if endorsed by guideline developers, may palliate some of the shortcomings identified. Our proposal may also inform future updates of the GRADE guidance for GPS.

Which actionable statements qualify as good practice statements In Covid-19 guidelines? A systematic appraisal.

OBJECTIVES: To evaluate the development and quality of actionable statements that qualify as good practice statements (GPS) reported in COVID-19 guidelines. DESIGN AND SETTING: Systematic review . We searched MEDLINE, MedSci, China National Knowledge Infrastructure (CNKI), databases of Grading of Recommendations Assessment, Development and Evaluation (GRADE) Guidelines, NICE, WHO and Guidelines International Network (GIN) from March 2020 to September 2021. We included original or adapted recommendations addressing any COVID-19 topic. MAIN OUTCOME MEASURES: We used GRADE Working Group criteria for assessing the appropriateness of issuing a GPS: (1) clear and actionable; (2) rationale necessitating the message for healthcare practice; (3) practicality of systematically searching for evidence; (4) likely net positive consequences from implementing the GPS and (5) clear link to the indirect evidence. We assessed guideline quality using the Appraisal of Guidelines for Research and Evaluation II tool. RESULTS: 253 guidelines from 44 professional societies issued 3726 actionable statements. We classified 2375 (64%) as GPS; of which 27 (1%) were labelled as GPS by guideline developers. 5 (19%) were labelled as GPS by their authors but did not meet GPS criteria. Of the 2375 GPS, 85% were clear and actionable; 59% provided a rationale necessitating the message for healthcare practice, 24% reported the net positive consequences from implementing the GPS. Systematic collection of evidence was deemed impractical for 13% of the GPS, and 39% explained the chain of indirect evidence supporting GPS development. 173/2375 (7.3%) statements explicitly satisfied all five criteria. The guidelines' overall quality was poor regardless of the appropriateness of GPS development and labelling. CONCLUSIONS: Statements that qualify as GPS are common in COVID-19 guidelines but are characterised by unclear designation and development processes, and methodological weaknesses.

An evaluation of the COVID-19 recommendation map identified diverging clinical and public health guidance.

OBJECTIVES: To describe divergence between actionable statements issued by coronavirus disease 2019 (COVID-19) guideline developers cataloged on the "COVID-19 Recommendations and Gateway to Contextualization" platform. STUDY DESIGN AND SETTING: We defined divergence as at least two comparable actionable statements with different explicit judgments of strength, direction, or subgroup consideration of the population or intervention. We applied a content analysis to compare guideline development methods for a sample of diverging statements and to evaluate factors associated with divergence. RESULTS: Of the 138 guidelines evaluated, 85 (62%) contained at least one statement that diverged from another guideline. We identified 223 diverging statements in these 85 guidelines. We grouped statements into 66 clusters. Each cluster addressed the same population, intervention, and comparator group or just similar interventions. Clinical practice statements were more likely to diverge in an explicit judgment of strength or direction compared to public health statements. Statements were more likely to diverge in strength than direction. The date of publication, used evidence, interpretation of evidence, and contextualization considerations were associated with divergence. CONCLUSION: More than half of the assessed guidelines issued at least one diverging statement. This study helps in understanding the types of differences between guidelines issuing comparable statements and factors associated with their divergence.

The CAMP study: feasibility and clinical correlates of standardized assessments of substance use in a youth psychiatric inpatient sample.

BACKGROUND: To determine: (a) the feasibility and acceptability of administering a standardized electronic assessment of substance use and other mental health concerns to youth admitted to an inpatient psychiatric unit, and (b) the prevalence and clinical correlates of substance use in this sample. METHODS: The sample included 100 youth between the ages of 13 to 17 years admitted to an inpatient psychiatric unit in Ontario, Canada between September and November 2019 (78% response rate). Youth data were comprised of electronic self-reported assessments (during hospitalization and 6-months following) and chart reviews (99% consented; historical and prospective). Frontline staff completed a self-report survey assessing their perceptions of the need for standardized substance use assessments, training, and interventions on the unit (n = 38 Registered Nurses and Child and Youth Workers; 86% response rate). Analyses included descriptive statistics, correlations, regression, and qualitative content analysis. RESULTS: Feasibility of standardized youth self-reported mental health and substance use assessments was evident by high response rates, little missing data, and variability in responses. 79% of youth had used at least one substance in their lifetime; 69% reported use in the last 3 months. Substance use was positively correlated with severity of psychiatric symptoms (τb 0.17 to 0.45) and number of psychiatric diagnoses (τb 0.17 to 0.54) at index. Based on prospective and retrospective data, substance use was also positively related to mental health symptom severity at follow-up and repeat mental health related hospital visits. Frontline staff reported a need for standardized assessment, training, and interventions on the unit, indicative of acceptability. CONCLUSIONS: This study demonstrated the feasibility, acceptability and clinical importance of administering a standardized mental health and substance use assessment among youth experiencing psychiatric hospitalization.